Learnings

Outcomes

The Dynamic Reserve Setting has achieved the following: 

• Built an ETL pipelines for cleaning data from ESO systems to be used in reserves forecasting
• Built a database to store the cleaned data and forecast predictions on ESO systems
• Delivered a software suite which can run and re-train several probabilistic ML model for reserves levels
• Demonstrated that Machine Learning can be used to make better predictions of reserves when compared to the current approach
• Successfully used SHAP values to provide explanations for each prediction made by the Machine Learning model and these explanations were well received by the control room engineers
• Created a dashboard to display the models outputs to be used by control engineers to inform their decision making about reserves in real time. 

We are currently working on implementing the work developed under the Dynamic Reserve Setting project.  Work to date has focused on building the capability to train and deploy a model on ESO systems and integrate it with the dashboard.  Once this phase of work has been completed the model will be run in shadow mode so that users of reserves recommendations within ESO can explore the data and provide feedback to improve future releases of the model.

Lessons Learnt

A key lesson learnt was that liaising with control room staff to gather requirements and feedback is difficult.  Control staff work on a shift pattern whereas the rest of the members of the project team worked office hours.  This was exacerbated by the fact that control room staff are often too busy to join meetings when they are working in the control room.  For this reason, it was determined that a single point of contact with control staff should be established, this took the form of a control engineer whom had been seconded to an office based team.  This member of staff worked one shift a week across all shifts and so was able to gather feedback from control staff and deliver feedback to the project. 
 
A further lesson learnt was how the control staff interact with the data that is provided to them.  How the data is presented on a dashboard is directly related to how useful it is in a decision-making scenario.  There are many different opinions amongst control staff so many options to customise the data display were given to make the dashboard have as much utility as possible.